18.05 Spring 2005 Lecture Notes 

18.05 Lecture 1 
February 2, 2005 



Required Textbook - DeGroot & Schervish, "Probability and Statistics," Third Edition 
Recommended Introduction to Probability Text - Feller, Vol. 1 

§1.2-1.4. Probability, Set Operations. 

What is probability? 

• Classical Interpretation: all outcomes have equal probability (coin, dice) 

• Subjective Interpretation (nature of problem): uses a model, randomness involved (such as weather) 

— ex. drop of paint falls into a glass of water, model can describe P(hit bottom before sides) 

— or, P(survival after surgery)- "subjective," estimated by the doctor. 

• Frequency Interpretation: probability based on history 

— P(make a free shot) is based on history of shots made. 

Experiment has a random outcome. 

1. Sample Space - set of all possible outcomes, 
coin: S={H, T}, die: S={1, 2, 3, 4, 5, 6} 

two dice: S={(i, j), i, j=l, 2, 6} 

2. Events - any subset of sample space 
ex. A C S, ^ - collection of all events. 

3. Probability Distribution - P: A ^ [0, 1] 
Event ACS, P(A) or Pr(A) - probabihty of A 



Properties of Probability: 

1. < P(.4) < 1 

2. ¥{S) = 1 

3. For disjoint (mutually exclusive) events A, B (definition ^ A n B = 0) 
P(A or B) = P(A) + P(B) - this can be written for any number of events. 
For a sequence of events Ai, A„, ... all disjoint {Ai n = 0, i ^ j): 

oo oo 
i=l i=l 

which is called "countably additive." 

If continuous, can't talk about P(outcome), need to consider P(set) 
Example: 5 = [0, 1], < a < 6 < 1. 
P([a, b]) = b- a, P(a) = P(6) = 0. 
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Need to group outcomes, not sum up individual points since they all have P = 0. 



§1.3 Events, Set Operations 




Jb.: 



Union of Sets: AU B = {s G S : s e A or s e B} 




A B 



Intersection: AnB = AB = {s & S : s & A and s & B} 




Complement: A" = {s e S : s ^ A} 




A B 



Set Difference: A\B = A- B = {s & S : s & A &nd s ^ B} = An B'' 
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Symmetric Difference: {A n B") U {B n A") 

Summary of Set Operations: 

1. Union of Sets: AU B = {s G S : s G A or s G B} 

2. Intersection: An B = AB = {s G S : s G A and s G B} 

3. Complement: A" = {s G S : s ^ A} 

4. Set Difference: A \ B = A - B = {s G S : s G A and s ^ B} = An B" 

5. Symmetric Difference: 

AAB = {s G S : {s G Aand s ^ B) or {s G B and s A)} = 
{A n B") U (B n A") 



Properties of Set Operations: 

1. AU B = BU A 

2. {AUB)UC = AU{BUC) 

Note that 1. and 2. arc also valid for intersections. 

3. For mixed operations, associativity matters: 

{AuB)nc = {Anc)u{Bnc) 

think of union as addition and intersection as multiplication: (A+B)C 

4. {A U B)^ = A" n B^ - Can be proven by diagram below: 



AC + BC 





Both diagrams give the same shaded area of intersection. 



5. {A n By = A'^U B'^ - Prove by looking at a particular point: 

sG{AnB)'' = s^{AnB) 

s^Aor s^B = sG A" or sgB'' 

sGiA'^U B") 

QED 



** End of Lecture 1 
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